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[i]  Accuracies  of  a  total  of  six  sea  surface  temperature  (SST)  climatologies  are 
investigated  in  the  tropical  Pacific  Ocean,  spanning  latitudes  from  30°N  to  30°S. 

Observation-based  climatologies  are  directly  obtained  from  their  original  sources  and 
typically  formed  from  satellite  measurements,  in  situ  data,  or  a  combination  of  both.  Other 
SST  climatologies  are  constructed  from  reanalyses  of  a  numerical  weather  prediction 
center.  All  products  have  different  features,  each  with  its  own  data  sources,  grid 
resolutions,  interpolation  methods,  sampling  periods,  and  biases.  Even  though  time 
periods  during  which  climatologies  were  formed  differ,  all  products  have  good  agreement 
with  each  other,  with  basin-averaged  mean  bias  values  of  almost  zero  and  RMS  SST 
differences  typically  <0.3°C  over  the  annual  cycle.  Nondimensional  skill  scores  between 
the  pairs  of  SST  products  are  close  to  1,  indicating  almost  perfect  agreement  everywhere 
except  in  the  western  equatorial  Pacific.  Comparisons  against  an  ensemble  climatology 
based  on  the  average  of  all  SST  climatologies  further  reveal  the  weaknesses  and  strengths 
of  each  product.  Additional  validations  are  performed  by  forming  climatologies  using 
SSTs  from  moored  buoys  of  the  Tropical  Atmosphere  Ocean  (TAO)  array  during 
1986-2005.  Overall,  very  small  cold  biases  of  ^0.2°C  and  near-perfect  skill  scores  are 
found  for  all  SST  climatologies  when  comparing  them  with  408-month-long  SST  time 
series  from  34  buoys.  In  general,  all  SST  produets  are  generally  accurate  enough  to  be 
used  for  various  climate  applications. 
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1.  Introduction 

[2]  Aeeurate  data  sets  for  elimatologieal  mean  SSTs  are 
highly  desirable  to  investigate  many  processes,  especially  in 
tropical  Paeifie  Ocean.  For  example,  tropical  Pacific  SST 
plays  a  central  role  in  atmosphere-ocean  heat  exchange 
processes,  with  various  implications  for  climate  change 
[e.g.,  Schneider  et  al .,  2002;  Thum  et  al .,  2002].  Reliable 
SSTs  in  the  tropical  Pacific  are  necessary  to  monitor  climate 
changes  [Webster,  1995]  and  El  Nino  Southern  Oscillation 
(ENSO)  events  [Diaz  and  Markgraf,  2000].  The  atmospherie 
internal  variability  over  the  North  Paeifie  is  also  elosely 
related  to  the  tropieal  Paeifie  SST  anomalies  [Chen  and 
van  den  Dool ,  1997;  Zhang  and  McPhaden ,  2006]. 

[3]  There  are  several  observation-based  SST  produets, 
providing  monthly  mean  SSTs  over  the  global  ocean  [e.g., 
Casey  and  Cornillon ,  1999].  An  observation-based  clima¬ 
tology  ean  be  based  on  historical  measurements,  sueh  as 
SSTs  from  ship  measurements,  drifting  buoys,  moored  buoys 
and  high-resolution  Conductivity,  Temperature,  Depth 
(CTD)  or  expendable  Bathy Thermograph  (XBT)  profiles 
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[Stephens  et  al ,,  2002].  SSTs  from  satellites,  from  in  situ 
sources  or  from  both  can  also  be  used  in  forming  the  product 
climatologies  [Reynolds  et  al. ,  2002].  Additionally,  there 
are  also  numerical  weather  prediction  (NWP)  model  prod¬ 
ucts  which  provide  high  temporal  resolution  (e.g.,  6  hourly) 
SSTs  from  which  monthly  climatologies  can  be  formed  An 
example  NWP  produet  is  the  European  Centre  for  Medium- 
Range  Weather  Forecasts  (ECMWF)  40-year  Reanalysis 
(ERA-40)  [Uppala  et  al .,  2005]. 

[4]  There  is  not  a  eoneise  and  consistent  statements  of 
accuracy  for  each  SST  product.  All  SST  climatologies  have 
their  unique  biases.  For  example,  different  biases  may 
emerge  where  the  climatologies  have  been  constructed  over 
different  time  intervals.  SSTs  from  NWP  products  could  be 
too  coarse  to  resolve  many  small  features,  especially  near  the 
eoastal  boundaries. 

[5]  The  major  goal  of  this  paper  is  to  quantify  accuracy  of 
elimatologieal  SSTs  from  various  products  which  have  their 
unique  features  and  biases.  Our  purpose  is  not  to  fully 
identify  one  elimatology  as  superior  to  the  others.  Rather, 
we  examine  multiple  climatologies,  each  with  its  own  data 
sourees,  methods,  sampling  periods  and  biases.  Where  the 
climatologies  agree,  wc  will  have  increased  confidence  in 
the  consensus  results,  particularly  since  we  arrive  at  the 
consensus  using  different  approaches.  Where  agreement  is 
less,  wc  will  have  a  better  estimate  of  the  uncertainty  in  the 
elimatologieal  fields.  Variations  that  fall  within  this  uncer¬ 
tainty  are  less  significant  than  those  that  fall  outside. 
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Table  1.  Abbreviations  Used  for  SST  Products  Throughout 
the  Text 


Acronym 

Name  of  ihc  SST  Product 

PATH 

Pathfinder 

NOAA 

National  Oceanic  and  Atmospheric  Administration 

MODAS 

Modular  Ocean  Data  Assimilation  System 

WOAOl 

World  Ocean  Atlas,  2001 

ERA  15 

ECMWF  1 5-ycar  rcanalyscs 

F.RA40 

ECMWF  40-ycar  rcanalyscs 

[6]  Besides  the  evaluations  of  various  SST  climatologies 
through  comprehensive  statistical  analyses,  one  of  the  other 
focuses  of  this  study  is  to  provide  a  useful  contribution  to 
the  tropical  Pacific  oceanography.  Thus,  in  this  paper  we  put 
together  various  existing  but  dispersed  SST  data  sets  and 
make  their  detailed  assessment.  This  can  assist  in  studying 
various  climate-related  topics  mentioned  above,  and  in 
developing  ocean  prediction  systems  where  the  accuracy 
of  the  database  and  the  models  is  consistent  with  the  needs 
of  the  user  Such  evaluations  can  also  help  in  establishing 
whether  the  grid  resolution  and  data  sources  used  for 
constructing  climatologies  are  sufficient. 

2.  SST  Climatologies 

[7]  Monthly  mean  SST  climatologies  are  obtained  or 
formed  from  various  sources.  A  list  of  these  SST  products 
is  given  in  Table  1,  along  with  the  product  abbreviations 
used  throughout  the  text.  Sampling  period  and  data  sources 
used  for  constructing  the  monthly  means  vary  (Tabic  2). 
There  are  mainly  two  categories:  (1)  observation-based  SST 
climatologies  (PATH,  NOAA,  MODAS  and  WOAOl)  and 
(2)  SST  climatologies  formed  from  ECMWF  reanalyses 
(ERA  15  and  ERA40). 

[k]  Monthly  mean  SST  climatologies  for  observation- 
based  products  are  directly  obtained  from  their  original 
sources.  However,  we  form  monthly  mean  SST  climatolo¬ 
gies  for  NWP  products  on  the  basis  of  their  6  hourly 
outputs.  The  domain  considered  in  this  study  for  evaluating 
SST  products  in  Table  1  covers  the  tropical  Pacific  Ocean 
spanning  the  latitudes  from  30°S  to  30°N.  On  the  basis  of 
climatological  means  averaged  over  all  months  from  the 
PATH  data  set,  general  depictions  of  the  spatial  variations 
of  SST  reveal  distinct  features  in  this  region  (Figure  1). 
Particularly,  there  arc  cold  (warm)  temperature  values  in  the 
eastern  (western)  part  of  the  domain. 

2.1.  Observation-Based  SST  Products 

[9]  The  satellite-based  4  km  resolution  PATH  climatology 
is  derived  from  Advanced  Very  High  Resolution  Radiometer 
(AVHRR)  Pathfinder  SST  data  during  1985  2001.  The 


data  processing  was  done  using  SSTs  from  NOAA  polar 
orbiting  satellites.  This  climatology  uses  most  of  the  same 
techniques  presented  by  Casey  and  Comillon  [1999],  and 
has  a  resolution  of  4  km.  Key  improvements  in  the  new  PATH 
climatology  include  a  more  accurate,  consistent  land  mask, 
resulting  in  improvements  near  the  coastal  regions.  Both 
daytime  and  nighttime  daily  fields  are  included  in  each 
monthly  average.  The  monthly  climatologies  were  derived 
using  data  only  with  a  quality  flag  of  7.  In  general,  the 
Pathfinder  algorithm  combines  the  multiple  observations  as 
long  as  they  have  same  quality  level. 

[10]  The  NOAA  climatology  is  based  solely  on  observa¬ 
tional  SST  data  [Reynolds  et  ai,  2002].  In  particular,  the 
climatology  incorporates  in  situ  SSTs  from  ships  and  buoys 
(c.g.,  moored  and  drifting  buoys)  along  with  SSTs  from 
AVHRR  satellite  retrievals.  The  NOAA  SST  product  was 
built  from  two  intermediate  climatologies:  a  2°  SST  clima¬ 
tology  developed  from  in  situ  data  for  the  period  of  1971 
2000  and  a  1 0  SST  climatology  for  the  period  of  1 982  2000 
derived  from  the  second  version  optimum  interpolation 
(01. v2)  SST  analysis.  In  situ  SSTs  are  used  for  bias  correc¬ 
tion  in  forming  the  climatology. 

[it]  MODAS  SST  is  a  satellite-based  product  that 
includes  no  in  situ  SSTs  [Barron  and  Kara ,  2006].  Here, 
the  climatology  is  formed  over  the  time  period  1993  2005. 
It  is  produced  on  a  uniform  1/8°  (latitude,  longitude)  grid 
by  an  Ol  of  AVHRR  nonlinear  SST  (NLSST)  observa¬ 
tions  processed  by  the  Naval  Oceanographic  Office 
(NAVOCEANO).  All  operational  global  AVHRR  data  from 
1993  to  the  present  have  been  used  in  the  MODAS  analysis, 
reflecting  on  any  given  day  the  collected  global  coverage  data 
from  one  to  three  of  the  NOAA  polar  orbiters.  The  MODAS 
analysis  uses  a  Gaussian  error  covariance  with  60-h  time  and 
20-km  length  scales,  smaller  than  those  used  in  the  NOAA 
climatology.  These  scales  were  determined  subjectively  to 
balance  fidelity  in  representing  fronts  with  mitigation  of 
spurious  gradients  around  data-sparse  regions. 

[12]  The  climatology  from  WOAOl  is  formed  from  in  situ 
observational  SSTs  only.  Most  of  the  moored  SST  measure¬ 
ments  in  the  tropical  Pacific  are  included  in  the  climatology. 
Observational  data  used  in  WOAOl  were  averaged  by  1°  x  1° 
grids  for  input  to  the  objective  analysis  [Boyer  et  ai ,  2002], 
The  initial  objective  analyses  usually  contained  some  large- 
scale  gradients  over  a  small  area  or  bulls  eyes.  These  un¬ 
realistic  features  generally  occurred  because  of  the  difficulty 
in  identifying  nonrepresentative  values  in  data  sparse  areas. 

2.2.  ECMWF  Reanalyses 

[n]  There  are  two  reanalyses  from  ECMWF  used  for 
forming  SST  climatologies.  The  ERA1 5  (ERA40)  reanalysis 


Table  2.  Time  Intervals  and  Original  Gnd  Resolutions  for  the  SST  Products8 


Dala  Scl 

Interval 

Gnd  Resolution 

Time 

Reference 

Data  Source 

PATH 

1985-2001 

0.040°  x  0.040° 

variable 

Casey /  and  Cornillon  [  1 999] 

saicllite  only 

NOAA 

1971  2000 

1.000°  x  1.000° 

variable 

Reynolds  et  al  [2002] 

salcllilc,  in  silu 

MODAS 

1993  2005 

0.125°  x  0.125° 

daily 

Barron  and  Kara  [2006] 

satellite  only 

WOAOl 

1773-2001 

1.000°  x  1.000° 

vanablc 

Stephens  et  al.  [2002] 

in  situ  only 

ERA  15 

1979-  1993 

1.125°  x  1.125° 

6  hourly 

Gibson  et  al.  [  1 999] 

NWP-bascd 

ERA  40 

1957-2002 

1.125°  x  1.125° 

6  hourly 

Uppala  et  al.  [20051 

NWP-bascd 

"The  reader  is  referred  lo  given  references  for  further  details  aboul  each  product  The  availability  of  in  silu  and  satellite  observations  can  vary  from  one 
day  to  another  one;  thus,  observation-based  SST  climatologies  (i.c.,  PATH,  NOAA,  MODAS,  and  WOAOl)  arc  not  based  on  continuous  observations  in 
time  and  space. 
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Figure  1.  Climatologieal  mean  SST  in  °C  from  the  km  resolution  Pathfinder  data  set. 


is  available  for  1979  1993  (1957  2002).  The  ERA-40 
projeet  applies  a  modem  variational  data  assimilation  tech¬ 
nique  for  the  past  conventional  and  satellite  observations. 
The  model  physies  and  the  surfaee  parameterization  have 
been  upgraded  and  improved  sinee  ERA- 15.  Note  that  the 
SSTs  from  ECMWF  reanalyses  are  prescribed.  More  speeif- 
ieally,  ERA  15  and  ERA40  eome  from  the  Hadley  Centre  Sea 
lee  and  Sea  Surfaee  Temperature  (HAD1SST)  and  National 
Center  Environmental  Center  (NCEP)  2D-Var  data  sets, 
depending  on  the  period  considered.  Thus,  ECMWF  clima¬ 
tologies  examined  here  are  the  analyses  of  SST  observations 
prescribed  as  boundary  conditions.  For  this  reason,  they  are 
also  observation-based  SST  produets.  On  the  other  hand, 
compared  to  the  standard  ones  diseussed  in  section  2.1, 
ECMWF  reanalyses  have  higher  temporal  resolution  and 
coarser  spatial  resolution. 

[u]  We  form  climatologies  of  monthly  SST  from  ERA  15 
(1979  1993)  and  FRA40  (1957  2002)  using  6  hourly 
outputs.  These  reanalyses  use  a  consistent  data  assimilation 
scheme.  Therefore,  they  are  unaffeeted  by  operational 
model  upgrades. 

3.  Statistical  Metrics 

[15]  The  finest  resolution  (4  km)  PATH  is  taken  as  the 
reference  SST  climatology.  Other  produets  (i.e.,  NOAA, 
MODAS,  WOAOl,  ERA15,  and  ERA40)  are  evaluated  with 
respeet  to  PATH.  Comparisons  will  also  be  performed  among 
all  produets.  All  climatologies  are  interpolated  to  a  eommon 
grid  of  0.5°  x  0.5°,  so  that  they  ean  be  evaluated  at  eommon 
grid  locations.  While  this  resolution  may  inflate  the  informa¬ 
tion  content  of  products  which  have  resolution  lower  than 
this,  it  is  subjectively  ehosen  to  represent  all  products. 

[16]  There  are  always  advantages  (or  disadvantages)  of 
using  a  fine  resolution  SST  product  (e.g.,  PATH)  in  evalu¬ 
ating  a  eoarse  resolution  SST  product  (e.g.,  NOAA).  For 
example,  spatial  variability  of  SST  may  be  better  repre¬ 
sented  by  a  fine  resolution  one,  but  a  climate  modeler  may 
prefer  a  eoarse  resolution  produet  beeause  of  its  computa¬ 
tional  efficiency  sinee  global  climate  models  have  typically 
eoarse  resolution  to  reduce  computational  expense  on  super¬ 
computers.  When  interpolating  a  eoarse  resolution  SST 
produet  to  a  finer  grid  resolution,  there  are  definitely 


problems  in  the  accuracy  of  the  resulting  field  This  is 
particularly  true  for  NWP-based  SST  climatologies  as 
demonstrated  by  Kara  et  al  [2008].  In  that  study,  SSTs 
from  various  climatologies  are  interpolated  to  a  eommon 
grid  of  4  km  grid,  the  finest  resolution  of  the  produets 
considered  (i.e.,  PATH),  resulting  in  some  coastal  SST  differ¬ 
ences.  In  this  paper,  our  target  is  a  wider  audience,  not  only 
dealing  with  eoastal  and  regional  SSTs  but  also  global  SSTs 
for  climate  studies.  Therefore,  the  resolution  of  0.5°,  that  is 
more/less  representative  of  all  produets  is  ehosen  for  product 
comparisons. 

[17]  Evaluations  presented  here  are  based  on  monthly 
mean  time  series  of  SST  at  eaeh  oeean  gnd  point.  Let  Xj 
(i  =  1,2,  ,/i)  be  the  set  of  n  reference  (i.e.,  PATH)  SSTs,  and  let 
Yf  (i  =  1,2,,  n )  be  the  set  of  SSTs  for  any  one  of  the  other 
produets  (OTHER),  referring  to  any  one  of  the  climatologies 
(i.e^MODAS,  NOAA,  WOAOl,  ERA  15,  and  ERA40).  Also 
let  X  (F)  and  ox{oY )  be  the  mean  and  standard  deviations 
of  the  PATH  (OTHER)  SSTs,  respectively.  Beeause  we 
would  like  to  evaluate  SSTs  on  the  climatological  timescales, 
in  the  time  series  comparisons  n  is  equal  to  12.  Following 
Murphy  [1995],  the  statistical  metries  are  mean  error  (ME), 
root  mean  square  (RMS),  correlation  coefficient  (/?)  and  non- 
dimensional  skill  seore  (SS).  They  are  expressed  as  follows: 

ME  =  F  -  A\  (1) 


RMS  = 


1  '/2 


R  =  -Y,{Xi-X){Yi-Y)l{cxey), 


(2) 

(3) 


SS  =  R1  -  [R  -  (<7r/<7,)]2  -  [(7  -  X)/cx ]2  .  (4) 

s - '  v - -V - ' 

SrOND  %NCONT> 


In  brief,  ME  is  the  mean  SST  difference,  and  RMS  is  absolute 
measure  of  the  distance  between  the  PATH  and  OTHER  SST 
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(a)  FEB  (b)  JUN  (c)  NOV 
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Figure  2.  Monthly  mean  SST  climatologies  in  (a)  February,  (b)  June,  and  (c)  November,  They  arc 
shown  for  all  SST  products  as  described  in  section  2,  in  detail. 


time  series  over  the  annual  cycle.  R  is  a  measure  of  the  degree 
of  linear  association  between  the  two  time  series. 

[is]  The  SS  value  in  equation  (4)  is  the  fraction  of 
variance  explained  by  PATH  minus  two  nondimensional 
biases  (conditional  bias,  #cond>  and  unconditional  bias, 
Z?uncond)  that  are  not  taken  into  account  in  the  R  formu¬ 
lation  (sec  equation  (3)).  Z?uncond  is  also  called  systematic 
bias  and  is  a  measure  of  the  difference  between  the  means  of 
PATH  and  OTHER  SST  time  series.  Bc ond  is  a  measure  of 
the  relative  amplitude  of  the  variability  (standard  deviation) 
in  the  two  data  sets,  R2  is  equal  to  SS  only  when  2?cond  and 
Z?uncond  arc  zero.  Note  that  SS  is  1.0  if  PATH  and  any 
given  climatology  product  agree  with  each  other  perfectly. 
Positive  skill  is  usually  considered  to  represent  a  minimal 
level  of  acceptable  performance.  Negative  SS  indicates  poor 
agreement  for  a  given  SST  climatology  in  comparison  to 
PATH. 

4.  Evaluations  of  SST  Climatologies 

[19]  The  most  obvious  feature  of  the  climatological  long¬ 
term  annual  mean  SST  is  the  cold  tongue  region  in  the  eastern 


equatorial  Pacific  (Figure  1).  Annual  mean  of  SST  in  this 
region  can  bc  as  cold  as  22°C,  as  much  as  8°C  cooler  than 
other  regions  of  the  tropical  Pacific.  Vertical  mixing  and 
entrainment  are  critical  for  understanding  the  seasonal  cycle 
of  SST  in  the  eastern  Pacific  cold  tongue  [e.g.,  Wang  and 
McPhaden ,  1999]  Cold  SST  in  this  region  is  typically  a 
result  of  equatorial  upwelling  [e.g.,  Fiedler  and  Talley ;  2006]. 
SST  variability  in  the  cold  tongue  can  mainly  be  controlled 
by  the  changes  in  net  solar  radiation  at  the  sea  surface,  and 
annual  variations  of  surface  winds  can  also  significantly 
influence  the  SST  annual  cycle  in  the  eastern  Pacific  as  well 
[e.g.,  Kessler  et  al .,  1998]. 

[20]  There  are  no  major  changes  in  SST  by  month  in  the 
tropical  Pacific  (Figure  2).  For  simplicity,  we  only  show 
climatological  SSTs  in  February,  June,  and  November. 
Spatial  variations  of  SSTs  from  all  SST  products  are 
generally  similar,  while  some  differences  arise  especially  in 
the  equatorial  Pacific  cold  tongue.  SST  magnitudes  from  all 
climatologies  also  fairly  resemble  each  other.  For  example, 
SST  values  of  «25°C  in  February  become  «23°C  in  June 
and  even  colder  in  November  in  the  eastern  equatorial 
Pacific.  Climatological  SST  varies  slightly  by  month  in  the 
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(a)  Moan  bias  (  C)  (b)  RMS  difference  (  C)  (c)  Correlation  coeff. 


O  O  O  O  -»  -*  —  OOOOOOOOOO  — 

tfbwoinbuibgibwb  w  »  b*  oa  o  io  bb^Mwbutbi^bbb 


Figure  3.  Spatial  fields  of  (a)  mean  bias,  (b)  RMS  difference,  and  (c)  correlation  coefficient. 
Computations  arc  performed  at  each  grid  point  on  the  basis  of  1 2  monthly  mean  time  series  over  the  annual 
cycle  between  SST  products  and  PATH  climatology. 


western  Pacific  warm  pool,  where  SST  is  %30°C  in  February, 
June,  and  November. 

4.1.  SST  Bias  and  Correlation 

[21]  Wc  now  take  PATH  as  the  reference  data  set  and 
evaluate  other  climatologies  on  the  basis  of  various  statis¬ 
tical  metrics  of  ME,  RMS,  R,  #cond>  ^uncond*  R  and  SS. 
Statistical  metrics  (see  section  3)  arc  computed  at  each  grid 
point  over  the  annual  cycle  and  then  mapped  over  the  basin 
Figure  3  presents  the  resulting  spatial  fields  of  ME,  RMS 
SST  difference  and  R.  The  white  color  in  Figure  3a 
represents  bias  values  between  — 0.25°C  and  0.25°C,  indi¬ 
cating  that  annual  mean  SST  bias  for  each  product  is 
negligibly  small  over  most  of  the  region.  However,  there 
are  some  biases  in  the  eastern  and  central  tropical  Pacific.  In 
particular,  all  SST  products  are  typically  %0.5°C  warmer 
than  PATH,  with  WOAOl  having  warming  confined  to  a 
very  small  region  in  comparison  to  other  products. 

[22]  Similar  to  mean  bias,  RMS  values  are  generally 
small  (<0.3°C)  over  the  majority  of  the  region,  and  this  is 
true  for  almost  all  products  (Figure  3b).  Relatively  large 
RMS  SST  values  ranging  between  ^0.5°C  and  «1.0°C  are 
noted  in  the  eastern  and  central  equatorial  Pacific.  The 
satellite-based  MODAS  SST  product  is  an  exception,  in 
that  RMS  values  with  respect  to  PATH  are  lowest  (<0.3°C) 
in  the  same  region. 


[23]  While  WOAOl  shows  almost  no  SST  bias  in  the 
eastern  and  central  tropical  Pacific,  there  arc  relatively  large 
RMS  values  («0.8°C)  in  comparison  to  PATH.  The  same  is 
also  true  for  ERA  15  and  ERA40.  As  mentioned  earlier,  a 
difference  between  the  two  ECMWF  products  is  that  the 
SST  data  set  produced  by  the  Hadley  Centre  and  NOAA  has 
been  used  in  ERA40. 

[24]  As  to  the  annual  cycle  of  SST  products,  R  values  arc 
close  to  1 ,  indicating  nearly  perfect  agreement  with  the  PATH 
climatology  (Figure  3c).  The  only  region  where  R  values  are 
relatively  low  for  WOAOl  is  the  western  equatorial  Pacific 
warm  pool.  Very  little  variability  in  SST  is  the  main  reason  for 
having  low’  correlations  in  these  regions  as  will  be  further 
discussed  in  the  following  section.  Correlations  are  weak  in 
some  areas,  for  example,  in  the  western  equatorial  Pacific 
warm  pool. 

4.2.  SST  Skill  Score 

[25]  SST  standard  deviation  varies  from  one  location  to 
another  over  the  annual  cycle.  For  example,  standard  devia¬ 
tions  can  be  quite  large  (e.g.,  >2°C)  in  the  eastern  equatorial 
Pacific,  while  they  are  very  small  (e.g.,  <0.5°C)  in  the 
western  equatorial  Pacific  warm  pool  (Figure  4).  As  a  result, 
mean  bias  or  RMS  values  are  expected  to  be  small  (large)  in 
the  western  (eastern)  tropical  Pacific.  This  implies  that  the 
RMS  SST  difference  does  not  provide  fair  evaluation  about 
the  accuracy  of  SST  products  in  comparison  to  the  PATH 
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Figure  4.  Standard  deviation  of  SST  from  the  Pathfinder  climatology  calculated  on  the  basis  of 
12  monthly  mean  time  series  over  the  annual  eyele. 


climatology  at  those  locations  where  SST  standard  deviations 
vary  greatly.  A  normalization  is  therefore  essential,  whieh 
can  be  accomplished  by  using  a  skill  score. 

[26]  As  described  in  section  3,  the  nondimcnsional  skill 
score  (equation  (4))  aeeounts  for  both  conditional  and 
unconditional  biases.  SS  is  equal  to  1  (i.e.,  perfect  relation¬ 
ship  with  respect  to  PATH)  only  when  RMS  is  0.  Since  SS 


includes  both  RMS  and  standard  deviation  of  the  reference 
(i.e.,  PATH)  SSTs,  assessing  the  performance  of  a  given  SST 
product  at  two  different  locations  which  have  quite  different 
SST  annual  cycles  can  be  accomplished  in  a  normalized  sense. 

[2?]  Figure  5  includes  two  nondimensional  biases  (#cond 
and  Auncond)  and  the  resulting  skill  values  when  SST 
products  arc  validated  with  respect  to  PATH  climatology 


(a)  Conditional  bias  (1>)  Unconditional  bias  (i )  Skill  score 


OOO&OOd'OOS^DOOOOOOOOD^OO  ODOOO  aoa-t 


Figure  5.  Spatial  fields  (a)  conditional  bias,  (b)  unconditional  bias,  and  (e)  skill  score  computed  at  each 
grid  point  on  the  basis  of  monthly  time  series  over  the  annual  eyele  between  SST  products  and  PATH 
climatology.  Results  arc  shown  for  each  SST  product. 
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—  NOAA  —  MODAS  —  WOAOl  —  ERA15  —  ERA40 


D  D 

cond  °uncond  SS 


Figure  6.  Zonal  averages  of  statistical  metrics  shown  in  Figures  3  and  5.  Zonal  averaging  is  performed 
at  each  0.3°  latitude  belt. 


over  the  annual  cycle.  There  are  very  high  SST  skills  which 
are  almost  perfect  with  values  of  close  to  1  for  all  clima¬ 
tologies  everywhere  except  in  the  western  equatorial  Pacific 
warm  pool.  Previously,  Kara  and  Barron  [2007]  demon¬ 
strated  that  cloud  cover  can  affect  accuracy  of  satellite- 
based  daily  MODAS  SST  in  this  region,  and  addition  of  in 
situ  SST  is  typically  an  advantage  for  improving  the 
accuracy.  However,  in  the  ease  of  forming  a  climatology, 
that  is  not  a  concern  since  daily  SSTs  from  many  years 
contribute  to  the  MODAS  climatology,  thereby  yielding 
results  similar  to  other  climatological  products. 

[28]  Given  the  high  SST  skills,  all  SST  products  agree 
with  PATH  well  in  the  eastern  tropical  Pacific  (Figure  5c). 
On  the  other  hand,  previously  we  showed  in  Figure  3b  that 
RMS  is  very  high  in  the  eastern  equatorial  Pacific  but  is 
relatively  low  in  the  western  equatorial  Pacific,  implying  that 
all  products  agree  with  PATH  better  in  the  western  equatorial 
Pacific.  RMS  errors  in  the  western  equatorial  Pacific  are  low 
because  SST  standard  deviations  are  also  low  (i.e.,  small  SST 
variability  over  the  annual  cycle).  This  does  not  necessarily 
mean  that  there  is  good  agreement  between  any  one  of  the 
SST  products  and  PATH  since  SST  skill  scores  reveal 
otherwise.  However,  using  the  skill  score  in  measuring  the 
western  equatorial  Pacific  may  also  appear  to  be  less  reliable 
since  it  is  inflated  because  of  the  low  variance  in  the  region. 


[29]  Nondimensional  biases  in  SS  explain  the  source  of 
differences  between  the  SST  products  and  PATH  (Figures  5a 
and  5b).  Low  skill  values  in  the  western  tropical  Pacific  are 
mainly  due  to  conditional  biases  which  are  relatively  larger 
than  unconditional  biases  in  this  region.  On  the  basis  of  the 
definition  of  Bc ond  (see  section  3),  such  large  values  reveal 
that  biases  resulting  in  low  skill  are  due  mainly  to  differences 
in  standard  deviations  between  any  one  of  the  SST  products 
and  PATH.  On  the  contrary,  BCo nd  are  very  small  and  very 
close  to  zero  except  in  the  central  tropical  Pacific  for  SSTs 
from  ERA  15  and  ERA40,  explaining  that  biases  due  to  the 
differences  in  mean  SST  in  comparison  to  PATH  are  gener¬ 
ally  negligible. 

[30]  Zonal  averages  of  all  statistical  metrics  shown  in 
Figures  3  and  5  are  computed  in  order  to  investigate  similar¬ 
ities  and  differences  for  each  SST  product  depending  on  the 
latitudinal  region  (Figure  6).  In  comparison  to  the  PATH 
climatology,  all  SST  products  generally  yield  similar  patterns, 
having  relatively  poor  agreement  near  the  equatorial  regions, 
mostly  affected  by  the  results  in  the  western  equatorial  Pacific 
warm  pool.  The  agreement  with  respect  to  the  PATH  clima¬ 
tology  improves  significantly  away  from  the  equatorial 
regions.  Overall,  the  largest  conditional  and  unconditional 
values  are  noted  along  the  equatorial  region.  This  contributes 
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Table  3.  Areal  Averages  of  Statistical  Metrics  for  Each 
Observation-Based  SST  Climatology  in  the  Tropical  Pacific" 


PATH 

NOAA 

MODAS 

WOAOl 

ERA  15 

ERA40 

ME(°C) 

0.00 

-0.04 

PATH 

0.12 

-0.09 

0.00 

0.00 

RMS(°C) 

0.00 

0.21 

0.21 

0.31 

0.29 

0.24 

D 

°cond 

0.00 

004 

0.02 

0.05 

0.04 

0.03 

^uncond 

0.00 

0.08 

0.06 

0.07 

0.14 

0.10 

R 

1.00 

0.97 

0.97 

0.92 

0.97 

0.97 

SS 

1.00 

0.83 

0.87 

0.74 

0.76 

0.82 

ME(°C) 

0.04 

0.00 

NOAA 

0.16 

-0.05 

0.03 

0.03 

RMS(°C) 

0.21 

0.00 

0.24 

0.26 

0.20 

0.14 

^cond 

0.01 

0.00 

0.00 

0.01 

0.00 

0.00 

^uncond 

0.06 

0.00 

0.12 

0.05 

0.11 

0.05 

R 

0.97 

1.00 

0.98 

0.93 

0.99 

0.99 

SS 

0.88 

1.00 

0.82 

0.81 

0.86 

0.92 

ME(°C) 

-0.12 

-0.16 

MODAS 

0.00 

-0.21 

-0.12 

-0.09 

RMS(°C) 

0.22 

0.24 

0.00 

0.35 

0.30 

0.26 

^cond 

0.00 

0.02 

0.00 

0.02 

0.02 

0.01 

^unwind 

0.04 

0.14 

0.00 

0.13 

0.11 

0.09 

R 

0.97 

0.98 

1.00 

0.92 

0.97 

0.98 

SS 

0.90 

0.80 

1.00 

0.71 

0.81 

0.85 

ME(°C) 

0.09 

0.05 

WOAOl 

0.21 

0.00 

0.08 

0.08 

RMS(°C) 

0.31 

0.26 

0.35 

0.00 

0.33 

0.29 

^cond 

0.02 

0.05 

0.04 

0.00 

0.05 

0.04 

^uncond 

0.06 

0.05 

0.13 

0.00 

0.15 

0.08 

R 

0.92 

0.93 

0.92 

1.00 

0.93 

0.94 

SS 

0.77 

0.77 

0.69 

1.00 

0.68 

0.76 

aThc  domain  for  the  tropical  Pacific  is  shown  in  Figure  I.  See  lext  for 
descriptions  of  stalistieal  metrics. 


to  relatively  poor  agreement  in  the  equatorial  SST,  also 
evident  from  the  relatively  low  skill  values  in  these  regions. 

[31]  Finally,  areal  averages  of  statistical  metrics  over  the 
whole  domain  arc  further  computed  to  examine  relationship 
for  all  pairs  of  the  SST  products.  This  is  done  for  the 
observation-based  climatologies  (Table  3)and  other  clima¬ 
tologies  (Table  4),  separately.  For  example,  in  Table  3,  first 
the  PATH  is  taken  as  the  reference  data  set,  and  areal 
averages  of  each  statistical  metric  are  computed  relative  to 
all  other  climatologies  as  shown  in  the  statistical  maps  of 
Figures  3  and  5.  Then,  the  NOAA  climatology  is  taken  as 
the  reference  data  set  and  evaluated  against  all  other  products. 
Similar  computations  are  repeated  for  the  other  products. 

[32]  Evaluations  provided  in  Tables  3  and  4  further 
confirm  the  close  relationship  among  all  data  products.  Areal 
averages  of  mean  bias  values  are  almost  zero,  and  those  of 
RMS  SST  differences  rarely  exceed  0.3°C  regardless  which 
product  pairs  are  compared.  There  are  also  remarkable 
agreements  for  the  SST  annual  cycle,  as  evident  from  high 
correlation  coefficients,  close  to  1 ,  calculated  over  the  annual 
cycle.  Similarly,  relatively  small  conditional  biases  in  com¬ 
parison  to  unconditional  biases  indicate  that  biases  are 
mainly  due  to  differences  in  the  means  of  SSTs  rather  than 
standard  deviations. 

5.  Ensemble  SST  Climatology 

[33]  In  sections  4.1  and  4.2,  the  PATH  climatology  is 
mainly  taken  as  a  reference  product  and  compared  to  each 
one  of  the  other  climatologies.  Although  PATH  is  taken  as  a 


reference,  we  have  not  determined  whether  or  not  it  is  the 
best  climatology.  In  addition,  analysis  in  terms  of  differ¬ 
ences  from  PATH  provide  very  little  information  about  the 
shortcomings  of  it.  For  example,  PATH  is  affected  by  cloud 
contamination  [e.g.,  McClain  et  al .,  1985;  Luo  et  ai,  1995]. 
While  its  higher  spatial  resolution  is  an  advantage,  this  docs 
not  necessarily  imply  that  it  is  the  best  product.  Similar  to 
PATH,  other  SST  products  have  also  their  own  advantages 
and  disadvantages. 

[34]  For  the  reasons  mentioned  in  the  preceding  paragraph 
we  produce  a  new  SST  climatology  for  validating  all  SST 
products  rather  than  using  any  single  product  as  the  reference. 
To  accomplish  that  goal,  we  form  means  of  SSTs  from  all  the 
products  (PATH,  NOAA,  MODAS,  WOAOl,  ERA  15  and 
ERA40)  at  each  grid  point,  and  then  obtain  spatial  variations 
over  the  tropical  Pacific.  Forming  a  mean  climatology  is 
performed  month  by  month.  For  example,  January  clima¬ 
tology  is  constructed  by  computing  mean  January  SSTs  from 
all  six  SST  climatologies.  Thus,  we  obtain  a  reference 
monthly  mean  climatology,  incorporating  SST  information 
from  all  products.  This  new  product  would  average  out  errors 
in  any  individual  SST  climatology.  In  addition,  it  does  not 
imply  a  judgment  about  which  product  is  best.  Hereafter,  we 
will  call  this  new  reference  product  the  ensemble  climatology. 

[35]  Mean  SST  biases  for  each  SST  product  with  respect 
to  the  ensemble  climatology  are  shown  in  Figure  7.  No 
systematic  bias  is  noted  and  differences  arc  within  ±0.1  °C 
for  all  climatologies  over  most  of  the  tropical  Pacific  Ocean. 
Relatively  large  biases  are  generally  noted  in  the  eastern  and 
central  equatorial  Pacific  for  PATH  and  ERA40.  In  partic¬ 
ular,  PATH  (ERA40)  is  typically  colder  (warmer)  than  the 
ensemble  product  by  ^0.3°C  in  the  eastern  equatorial 
Pacific.  Reynolds  et  al.  [2007]  noted  a  similar  overall  cold 
PATH  bias  of  0.1  0.3°C,  with  nighttime  SSTs  showing 
relatively  larger  cold  bias.  Basin  averages  of  annual  mean 
SST  biases  are  near  zero  for  all  products  except  for  MODAS 
which  has  a  warm  bias  of  ^0.1 2°C. 

[36]  Similar  to  mean  bias,  we  also  compute  RMS  SST 
difference,  correlation  and  skill  score  values  for  each  SST 
products  in  comparison  to  the  ensemble  climatology  over  the 
seasonal  cycle  (Figure  8).  The  most  striking  feature  of  RMS 
differences  is  that  both  NOAA  and  MODAS  have  much 
smaller  biases  in  the  cold  tongue  region  than  other  products 
(Figure  8a).  Overall,  all  products  have  RMS  values  of  <0.2°C 
over  majority  of  the  tropical  Pacific  Ocean.  The  NOAA 


Table  4.  Same  as  Table  3  but  for  the  Climatologies  From 
ECMWF  Reanalyscs 


PATH 

NOAA 

MODAS 

WOAOl 

FRA15 

ERA40 

ME(°C) 

0.00 

-0.04 

ERA  15 
0.12 

-0.08 

0.00 

0.00 

RMS(°C) 

0.29 

0.20 

0.30 

0.33 

0  00 

0.12 

^cond 

0.00 

0.00 

0.01 

0.01 

0.00 

0.00 

^uncond 

Oil 
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Figure  7.  Spatial  fields  of  mean  biases  for  SST  climatol¬ 
ogies  with  respeet  to  the  ensemble  climatology.  The  bias  is 
computed  over  the  seasonal  cycle. 


climatology  has  the  lowest  basin-averaged  RMS  value  of 
0.11°C.  However,  basin-averaged  RMS  values  for  other 
observation-based  climatologies  are  similar:  0.1 5°C  for 
PATH,  0.1 6°C  for  MODAS  and  0.2 1°C  for  WOAOl  Simi¬ 
larly,  NWP-bascd  climatologies  have  RMS  values  ofO.  18°C 
and  0. 1 5°C  for  ERA  1 5  and  ERA40.  All  products  also  eapture 
SST  seasonal  cycle  in  a  manner  consistent  with  the  ensemble 
climatology  as  evident  from  correlation  values  close  to  1 
(Figure  8b).  Finally,  all  climatologies  yield  near-perfcct  skill 
values  (Figure  8c).  Relatively  low  SST  skill  with  respeet  to 
ensemble  climatology  is  seen  in  the  western  equatorial 
Pacific.  Basin-averaged  SST  skill  values  ranges  from  0.86 
for  WOAOl  being  lowest  to  0.95  for  NOAA  being  highest. 

[37]  We  also  examine  SST  differences  for  each  produet 
along  with  the  standard  deviation  of  the  ensemble  elimatology. 
Our  purpose  is  to  identify  the  regions  of  high  or  low 
variability  among  the  climatologies  and  indicate  where  biases 
of  one  product  are  significantly  different  from  the  ensemble 
variation.  The  differences  reveal  patterns  that  may  indicate 
modes  of  variability  in  tropical  Pacific  SST. 

[3s]  Standard  deviation  of  the  ensemble  elimatologieal 
SST  is  computed  each  month  using  six  mean  SSTs,  one  from 
each  contributing  product  (i.e.,  PATH,  NOAA,  MODAS, 
WOAOl,  ERA15,  and  ERA40).  For  simplicity,  the  resulting 
fields  of  SST  standard  deviations  are  given  for  three  selected 
months  of  February,  June,  and  November  (Figure  9a).  The 
common  feature  evident  from  all  months  is  that  standard 
deviation  values  arc  <0.5°  over  majority  of  the  tropical 
Pacific,  with  some  larger  variation  in  parts  of  the  eastern 
equatorial  Pacific.  All  fields  reveal  noticeable  spatial  varia¬ 
tions.  In  particular,  the  standard  deviations  indicate  at  least 
two  regions  of  high  variability:  a  zone  centered  on  the  equator 
with  higher  variability  in  the  eastern  Pacific  and  a  tropical  rim 
zone  with  higher  variability  in  the  far  western  Paeifie  and  the 
subtropical  western  Paeifie  near  ±30°  latitude. 

[39]  Monthly  mean  SST  differences  relative  to  the 
ensemble  elimatology  are  shown  in  Figure  9b  (i.e.,  PATH 
ensemble,  NOAA  ensemble,  etc.).  This  is  done  for  each 
month  separately.  Sealing  these  by  the  standard  deviation  of 
the  ensemble  elimatology  overemphasizes  some  of  the  low- 
amplitude  variations  and  obscures  some  of  the  variability 
patterns.  However,  SST  differences  are  considered  relative  to 
the  variation  patterns  identified  in  the  standard  deviation 
(Figure  9a).  In  general,  absolute  values  of  SST  biases  from 
each  product  arc  within  the  range  of  SST  standard  deviations 
given  in  Figure  9a  There  are  exceptions.  For  example, 
standard  deviation  of  SST  biases  for  WOAOl  are  generally 
>0.5°C  in  the  eastern  tropical  Pacific,  especially  in  June. 
Similar  features  arc  also  evident  from  ERA  15  and  PATH 
in  the  central  tropical  Pacific,  along  the  higher-variability 
portions  of  the  equatorial  zone.  ERA  15,  ERA40  and 
MODAS  all  have  higher  deviations  along  the  tropieal  rim, 
with  cold  bias  in  the  ECMWF  products  and  warm  bias  in 
MODAS.  This  may  reflect  a  warming  in  the  western  Pacific 
between  the  1979  1993  period  of  ERA  15  elimatology  and 
the  1993  2005  MODAS  penod. 

6.  Climatological  SST  Evaluation  at  Moored 
Buoys 

[40]  In  section  4,  SST  climatologies  are  evaluated  relative 
to  the  finest  resolution  PATH  product.  Further  comparisons 
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Figure  8.  Spatial  fields  of  (a)  RMS  difference,  (b)  correlation  coefficient,  and  (e)  skill  score  for  SST 
climatologies  in  comparison  to  the  ensemble  SST  climatology.  Statistical  metrics  are  computed  at  each 
grid  point  on  the  basis  of  12  monthly  mean  time  senes  over  the  annual  cycle. 


are  also  presented  when  choosing  each  one  of  SST  clima¬ 
tology  as  a  reference,  separately.  In  addition,  evaluations  are 
performed  relative  to  the  ensemble  climatology  in  section  5. 

[4 1  ]  The  preceding  analysis  procedure  is  helpful  for 
providing  information  about  differences  among  the  products 
in  the  tropical  Pacific  Ocean,  but  do  not  provide  an 
independent  assessment  procedure  since  no  validation  was 
performed  on  the  basis  of  observed  SSTs.  In  this  section, 
additional  evaluations  on  the  accuracy  of  climatological 
products  are  obtained  on  the  basis  of  the  SSTs  measured 
from  moored  buoys.  To  evaluate  accuracy  of  each  climato¬ 
logical  product,  we  use  SSTs  from  many  moored  buoys 
located  in  the  tropical  Pacific  Ocean  (Figure  10).  These 
buoys,  maintained  by  the  Tropical  Atmosphere  Ocean 
(TAO)  array  project  office,  regularly  reports  high-resolution 
(e.g.,  daily)  SSTs  [McPhaden  et  al ,  1998].  Although  the 
spatial  sampling  is  sparse  and  there  can  be  missing  daily 
SST  measurements,  a  data  set  like  this  provides  a  good 
opportunity  for  evaluations  of  climatological  products.  This 
is  because  SSTs  from  the  TAO  array  are  available  since 


1986,  providing  a  time  series  of  observations  sufficient  for 
constructing  local  SST  climatologies  at  many  buoys. 

[42]  For  our  validation  purposes,  daily  averaged  SST  from 
each  buoy  is  obtained,  and  monthly  mean  climatology  is 
formed  depending  on  the  availability  of  SSTs  from  1986  to 
2005.  Each  buoy  has  variable  number  of  year-long  daily  SST 
time  series  within  this  time  frame.  We  first  form  monthly 
mean  SST  at  each  buoy  location  for  a  given  year.  If  a  buoy 
has  fewer  than  30  days  of  observed  SST  in  a  month,  then  this 
month  is  ignored  in  the  local  analysis.  Monthly  mean  SSTs  at 
a  buoy  location  is  constructed  only  when  at  least  10-ycar- 
long  monthly  mean  SST  time  series  are  available.  All  TAO 
buoys  arc  marked  in  Figure  10,  but  only  buoys  with  10  or 
more  years  of  daily  long  SST  were  used.  As  shown,  there  are 
a  total  of  34  buoys  where  there  are  at  least  10-year-long  time 
series  of  monthly  SSTs,  and  the  number  of  years  during 
which  climatologies  are  constructed  are  given  in  Figure  10. 
For  example,  SST  climatology  at  (0°N,  110°W),  located  in 
the  eastern  equatorial  Pacific,  is  formed  on  the  basis  of  daily 
SSTs  from  a  total  of  15  years  of  data.  The  number  of  daily 
SSTs  used  in  obtaining  the  monthly  climatologies  is  given  in 
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(;i)  Standard  deviation  of  monthly  ensemble  SST  climatology 


0.(1  0.1  M.2  0.3  0,4  0.5  {  C) 

(b)  Monthly  mean  SST  difference  from  the  ensemble  climatology 
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Figure  9.  (a)  SST  standard  deviation  of  the  ensemble  climatology  computed  using  monthly  mean  values 
from  PATH,  NOAA,  MODAS,  WOA01,  ERA  15,  and  ERA40  for  selected  months  of  February,  June,  and 
August,  (b)  Monthly  mean  SST  difference  for  each  climatological  SST  product  in  comparison  to  the 
ensemble  climatology.  The  difference  is  computed  by  subtracting  the  ensemble  climatological  SST  from 
each  product  as  explained  in  the  text. 


Figure  11,  and  may  vary  depending  on  the  buoy;  for 
example,  there  are  relatively  fewer  daily  SST  at  the  other 
TAO  location,  (0°N,  I65°E),  because  of  missing  buoy  SST 
measurements  in  some  months. 

[43]  Time  series  of  climatological  SST  at  (0°N,  110°W) 
from  all  products  are  compared  in  Figures  12a  and  12b, 
respectively.  Sampling  errors  based  on  interannual  variability 
are  computed  at  (0°N,  1 10°W)  on  the  basis  of  TAO  SST.  This 


is  done  to  put  differences  among  the  climatologies  in  context 
and  examine  whether  the  monthly  differences  for  each 
product  in  comparison  to  the  buoy  SST  exceeds  these 
sampling  errors.  In  the  analysis  we  assume  that  each  year  is 
independent.  An  estimate  of  sampling  error  is  determined  as 
follows:  (1)  The  monthly  mean  SST  from  the  TAO  buoy  is 
calculated  for  each  year.  (2)  Standard  deviation  of  these 
monthly  means  arc  then  computed.  This  is  the  standard 
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Figure  10.  Locations  of  the  moored  buoys  from  the  TAO  array  where  monthly  mean  SST  climatologies 
were  constructed  to  eompare  with  elimatologieal  SSTs  from  the  six  produets  desenbed  in  seetion  2.  The 
number  of  years  whieh  are  used  for  forming  monthly  climatologies  is  indicated  by  a  two-digit  number. 


deviation  associated  with  interannual  variability.  (3)  The 
standard  error  of  the  mean  is  obtained  for  eaeh  month  by 
dividing  standard  deviation  by  y/n  where  n  is  the  number  of 
means  for  eaeh  month  in  the  interannual  series  As  mentioned 
earlier,  n  is  set  to  15  years  at  (0°N,  1 10°W),  and  n  is  set  to 
10  years  at  (0°N,  165°E).  Standard  error  of  the  mean  at 
both  locations  is  given  in  Figure  1 3,  demonstrating  relatively 
large  values  at  (0°N,  110°W)  sinee  SST  standard  deviation 
is  higher  in  comparison  to  those  at  (0°N,  165°E).  (4)  Finally, 
the  eonfidenee  limits  at  95%  are  obtained.  For  this,  standard 
error  of  the  mean  SST  is  multiplied  by  1.96  and  is  added/ 
subtracted  from  the  elimatologieal  mean  SST  for  eaeh  month. 

[44]  SSTs  from  all  produets  generally  agree  with  those 
from  the  buoy  as  seen  from  large  positive  skill  seores 


(Table  5).  RMS  values  for  ERA  15  and  ERA40  are 
relatively  larger  (^0.6°C)  than  those  for  the  observation- 
based  climatologies  (<0.4 °C)  over  the  12-month  period.  As 
seen  from  Figure  12,  monthly  SSTs  from  all  produets  are 
generally  within  the  upper  and  lower  limits  of  observational 
buoy  SST.  Exceptions  oeeur  in  February  and  April  when 
SSTs  from  WOAOl  and  ERA40  fall  outside  of  TAO  uncer¬ 
tainty  bands.  ERA  15  is  also  outside  of  the  uncertainty  range 
in  April  but  it  is  just  within  the  limits  for  February.  NOAA, 
ERA  1 5  and  ERA40  are  close  but  nearly  inside  the  upper  SST 
limit  in  January. 

[45]  SST  skill  is  the  largest  for  MODAS  and  NOAA 
climatologies  at  the  two  TAO  buoy  locations  (Table  5). 
In  the  former,  the  elimatology  was  formed  using  daily 
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Figure  11.  Total  number  of  daily  SST  measurements  from  two  TAO  buoys  by  month  during  1986 
2005.  These  SSTs  are  used  for  forming  monthly  mean  elimatology  at  eaeh  buoy  location. 
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Figure  12,  Climatological  mean  of  SST  time  scries  at  (0°N,  110°W)  located  in  the  eastern  equatorial 
Pacific.  Monthly  SST  climatology  from  the  TAO  buoy  is  also  shown  for  comparison  purposes.  Also 
shown  are  the  confidence  limits  at  95%  based  on  the  standard  error  of  the  SSTs  from  the  TAO  buoy. 


Jan  Feb  Mar  Apr  May  Jun  Jul  Aug  Sep  Oct  Nov  Dec 
Months  (1986-2005) 


Figure  13.  The  standard  error  of  the  mean  SST  for  each  month.  As  described  in  the  text,  computations 
are  performed  on  the  basis  of  daily  SSTs  at  two  locations. 
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Table  5.  Validation  of  Climatological  SST  at  Two  TAO  Buoy 
Locations3 


Climatology 

ME  (°C) 

RMS  CC) 

(°C) 

<T,(°C) 

R 

SS 

PATH 

-0.28 

Buoy  <(fN.  HOPW) 

0  43  1  28 

1.54 

0.99 

0.89 

NOAA 

0.18 

0.28 

1  28 

1.39 

0  99 

0.95 

MODAS 

0.04 

0.23 

1.28 

1.40 

0  99 

097 

WOAOl 

0.22 

0.36 

1.28 

1.42 

0  98 

0.92 

ERA  15 

0.47 

0.53 

1.28 

1.41 

0.99 

0.83 

ERA40 

0.52 

0.58 

1.28 

1.40 

0.99 

0.79 

PATH 

-0.23 

Buoy  (0°N,  16S°E) 
0.29  0.14 

0.24 

0.71 

<0 

NOAA 

-0.33 

0.34 

0.14 

0.10 

0.75 

<0 

MODAS 

-0.08 

0.15 

0  14 

0.18 

0.75 

<0 

WOAOl 

-0,26 

031 

0.14 

0.16 

0.37 

<0 

ERA  15 

-0.01 

0.09 

0.14 

0.10 

0.74 

0.55 

FRA40 

-0.02 

0.06 

0.14 

0.13 

0.85 

0.71 

Buoys  arc  located  ai  eastern  and  wcslcm  equatorial  Pacific.  Statistical 
values  arc  computed  on  the  basis  of  12  monthly  SSTs.  Here,  ax  (vY)  refers 
to  standard  dcvialion  of  SSTs  from  buoys  (products)  over  the  annual  cycle. 


AVHRR-only  SST  time  series  from  1993  to  2005  (see 
Table  2),  a  time  period  including  the  one  during  which  the 
monthly  climatology  from  the  TAO  buoy  was  constructed. 
This  indicates  the  consistency  in  producing  a  climatology 
from  MODAS  and  TAO  buoys,  resulting  in  slightly  better 
agreement  in  comparison  to  other  products.  NOAA  SST 
climatology  incorporates  the  buoy  SST  in  the  analysis, 
contributing  to  good  agreement  with  buoy  SSTs.  Overall, 
even  the  agreement  for  SST  climatologies  from  the 


ECMWF  reanalyses  in  comparison  those  from  buoys  at 
TAO  locations  is  about  as  good  as  the  for  the  observation- 
based  climatologies. 

[46]  One  region  where  SST  skill  is  relatively  low  for 
climatological  products  in  comparison  to  PATH  involves  the 
western  equatorial  warm  pool  as  was  already  indicated  in 
Figure  5.  Hence  we  examine  the  accuracy  of  SSTs  from  all 
climatologies  relative  to  those  from  a  TAO  buoy  located 
within  the  warm  pool  at  (0°N,  165°E).  The  most  obvious 
feature  of  the  SST  at  this  location  is  that  there  is  very  small 
SST  variability  over  the  12-month  period  (Figure  14). 
Standard  deviation  of  SST  is  0. 14°C,  which  is  much  smaller 
than  1.28°C  observed  at  the  buoy  located  in  the  eastern 
equatonal  Pacific  (0°N,  1 10°W).  However,  SST  skill  is  also 
small  at  the  former  location.  In  fact,  the  SST  standard 
deviations  are  so  small  that  even  though  RMS  values  are 
low,  skill  calculations  result  in  negative  values  (Table  5). 

[47]  Despite  the  low  skill  values  at  (0°N,  165°E),  the 
monthly  means  from  the  various  climatologies  usually  fall 
within  the  95%  confidence  range  for  the  TAO  means 
(Figure  14).  The  only  exceptions  are  that  NOAA  and/or 
WOAOl  are  outside  the  confidence  limits  of  buoy  SST  in 
July,  November,  and  December.  Overall,  results  are  similar 
to  those  seen  at  (0°N,  1 10°W),  in  that  most  of  the  monthly 
SSTs  are  within  the  range  of  observational  TAO  values. 

[48]  Finally,  we  combine  SSTs  from  all  34  TAO  buoys  at 
which  SST  climatologies  were  formed  using  at  least  10  years 
of  monthly  SSTs.  The  corresponding  SST  values  at  each 
location  are  extracted  from  each  climatology,  and  combined 


Figure  14.  The  same  as  Figure  12  but  at  (0°N,  165°E)  located  in  the  western  equatorial  Pacific. 
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Figure  15.  Scattcrplots  of  climatological  monthly  mean 
SSTs  from  all  34  TAO  buoys  versus  those  from  various 
products. 


together  as  in  the  buoy  SSTs.  A  seatterplot  is  then  produced 
for  SST  climatologies  between  the  buoy  versus  each  product 
(Figure  15). 

[49]  In  comparison  to  buoy  SSTs,  remarkable  agreement 
is  evident  for  all  SST  produets  as  evident  from  the  small 
scatter.  In  general,  differences  among  all  climatologies  ean 
be  considered  negligibly  small  as  noted  from  positive  and 
large  skill  values  elose  to  1  (Table  6).  SST  skill  drops  to  a 
smaller  value  when  the  same  statistics  are  calculated  only  at 
the  six  buoys  located  within  the  western  equatorial  Pacific 
warm  pool.  Again,  one  should  note  that  small  RMS  errors  in 
the  warm  pool  region  due  to  low  SST  variability  do  not  really 
indicate  that  all  products  have  good  skill  in  representing 
observed  SST  changes.  For  example,  NOAA  SST  has  lower 
RMS  value  of  0.22°C  in  the  warm  pool  region,  but  it  has  also 
much  lower  skill  Reynolds  et  al  [2007]  further  provided  a 
discussion  of  PATH  and  in  situ  SST  differences,  affecting 
these  climate  biases.  Typically,  PATH  tends  to  be  biased  cool 
because  of  cloud  contamination.  For  in  situ  data,  ships  tend 
to  be  biased  warm  relative  to  buoys. 

7.  Conclusions 

[50]  Studies  of  climate  change  require  that  baseline  climate 
be  accurately  identified.  The  tropical  Pacific  is  a  key  region 
that  drives  global  heat  budgets,  and  its  influence  on  climate 
variability  extends  far  beyond  its  loeal  vicinity.  Accurate 
assessment  of  mean  SST,  its  variability  and  its  uncertainty  is 


necessary  to  discern  the  significance  on  spatial  and  temporal 
timeseales  and  thereby  give  increased  confidence  in  ana¬ 
lyzing  various  topies  on  climate  change. 

[51]  Through  statistical  analyses,  we  demonstrate  that  the 
agreement  among  all  SST  climatologies  considered  in  this 
paper  is  quite  remarkable.  However,  they  typically  have  low 
skill  in  matching  the  buoy  climatology  in  the  western  Pacifie 
warm  pool;  in  fact,  only  the  ERA15  and  ERA40  climatolo¬ 
gies  have  positive  skill.  Yet  the  mean  and  RMS  errors  are 
fairly  small.  The  low  skill  is  a  eonsequence  of  the  very  low 
standard  deviation  in  the  TAO  observations,  which  amplifies 
the  impact  of  the  small  RMS  errors.  On  the  contrary,  RMS 
errors  are  larger  for  the  comparisons  at  1 1 0°W,  but  correla¬ 
tions  and  skill  score  are  mueh  higher  here,  approach ing  the 
perfect  value  of  1 .  The  other  climatologies  indicate  similarly 
low  standard  deviation  at  (0°N,  165°E)  with  the  TAO  SST 
approximately  the  median  of  the  values.  SST  standard 
deviations  in  this  region  are  close  to  the  precision  of  the 
measurements  themselves.  Thus,  this  paper  also  provides  a 
sound  basis  for  interpreting  SST  correlations  and  skill  score. 

[52]  The  significance  of  differences  among  SST  products 
elsewhere  should  be  judged  on  the  basis  of  the  intended 
applications.  SST  differences  of  a  few  tenths  of  a  degree  arc 
unimportant  for  daily  weather  forecasts  but  may  be  crucial 
for  estimates  of  global  climate  change  over  multiple  decades. 
The  variability  among  climatologies  suggests  that  a  multiyear 
temperature  ehange  of  this  magnitude  might  be  difficult  to 
diseem  in  the  eastern  equatorial  Paeific  but  an  enormous 
event  in  the  western  Pacifie  warm  pool.  Those  using  the 
climatologies  can  use  the  information  presented  here  to 
estimate  the  effeets  of  elimatologieal  uncertainty  on  their 
own  model  simulations  or  other  calculations.  Identifying  the 
size  of  the  differences  necessary  to  produee  significantly 
different  model  outcomes  is  beyond  the  scope  of  this  paper, 
but  is  a  critical  issue  for  climatological  applications. 

[53]  Finally,  we  expect  that  the  spatial  and  temporal 
variability  displayed  by  the  SST  climatologies  in  the  tropical 
Paeific,  as  presented  in  this  paper,  extend  to  other  regions. 
This  is  very  likely  for  those  data  sets  which  do  not  themselves 


Table  6.  SST  Error  Statistics  Between  Climatological  Products 
and  Buoys  at  TAO  Locations* 


Climatology 

ME  (°C) 

RMS  (°C) 

(°Q 

R 

SS 

PATH 

Statistics 

-0.23 

in  the  Whole  Pacific  Domain 

0.32  1.72  1.78 

0.99 

0.97 

NOAA 

-0.13 

0.26 

1  72 

1.59 

099 

0.98 

MODAS 

-0.03 

0.18 

1.72 

1.71 

0.99 

0.99 

WOAOI 

-0.19 

0.35 

1.72 

1.66 

0.98 

0.96 

ERA  15 

0.07 

0.27 

1.72 

1.59 

0.99 

0.97 

ERA40 

0.02 

0.26 

1.72 

1.59 

0.99 

0.97 

PATH 

Statistics  in  the  lies  tern  Equatorial  Pacific 
0.13  0.22  0.41  0.49 

0.94 

0.72 

NOAA 

-0.23 

0.27 

0.41 

0.33 

0.95 

0.57 

MODAS 

-0.01 

0.12 

0.41 

0.41 

0.96 

0.91 

WOAOI 

-0.21 

0.28 

0.41 

0.38 

0.90 

0.53 

ERA  15 

-0.13 

0.19 

0.41 

0.36 

0.94 

0.78 

ERA40 

-0.11 

0.16 

0.41 

0.39 

0.97 

0.84 

"Statistics  arc  computed  on  the  basis  of  monthly  mean  time  series  from 
all  34  TAO  buoys  (34  x  12  =  408  monthly  SST  values)  and  from  6  buoys 
(6  x  1 2  72  monthly  SST  values)  located  west  of  1 80°W,  separately.  Here, 

ax  refers  to  standard  deviation  of  buoy  SSTs,  and  oY  refers  to  standard 
deviation  of  climatological  SST  product. 
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incorporate  the  TAO  observations.  Long-term  observational 
efforts  similar  to  the  TAO  effort  would  be  useful  for 
answering  these  questions  and  identifying  the  uncertainties 
in  predictions  of  climate  change. 
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